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Box No. I Basis of the opinion 

(under Rules 12.3 and 23.1(b)). 
2 With reaard to any nucleotide andtor amino acid sequence disclosed in the international application and 
l!?ceSi^ to tif^^^ this opinion has been established on the basis of. 

a. type of material: 

□ a sequence listing 

□ tablets) related to the sequence listing 

b. format of material: 

□ in written format 

□ In computer readable fornr* 

c. time of filing/furnishing: 

□ contained in the international application as filed. 

□ filed together with the international application in computer readable form. 

□ furnished subsequently to this Authority for the purposes of search. 



3. □ in addrtion, in the case that more than one v^^^^^^^^^^ 

appropriate, were furnished. 

4. Additional comments: 
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Box No V Reasoned statement under Rule 43i>is.1 (a)(i) with regard to novelty, Inventive step or 
industrial applicability; citations and explanations supporting such statement 



1. Statement 

Novelty (N) 



Yes: Claims 
No: Claims 



6-8.11-12 
1-5,9-10, 13 



inventive step (IS) 



Industrial applicability (lA) 



Yes: Claims 

No: Claims 

Yes: Claims 

No: Claims 



6 

1-5, 7-13 
1-13 



2. Citations and explanations 



see separate sheet 
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Re Item V. 



1 Reference is made to the following documents: 

D1 • US-B1 -6 51 3 009 (COMERFORD ET AL) 28 January 2003 (2003-01 -28) 
D2: DATABASE INSPEC [Online] THE INSTITUTION OF ELECTRICAL 
ENGINEERS, STEVENAGE, GB; 15 December 1998 (1998-12-15), 
BREWSTER S: "The design of sonically-enhanced widgets" XP002334092 

Database accession no. 61 66302 
D3- US 2003/098892 A1 (HIIPAKKA) 29 May 2003 (2003-05-29) 
D4- SAWHNEY N ET AL: "NOMADIC RADIO: SCALEABLE AND CONTEXUAL 
NOTIFICATION FOR WEARABLE AUDIO MESSAGING" CHI '99 
CONFERENCE PROCEEDINGS HUMAN FACTORS IN COMPUTING 
SYSTEMS PITTSBURGH, PA; NEW YORK. NY : ACM, US, 1 5 May 1 999 
(1999-05-15), - 20 May 1999 (1999-05-20) pages 96-103. XP000894208 ISBN: 
0-201-48559-1 

D5- GAVER AND SMITH: "Auditory icons in large-scale collaborative environments 
HUMAN-COMPUTER INTERACTION - INTERACT 90 D. DIAPER ET AL. 
(EDITORS) ELSEVIER SCIENCE PUBLISHERS B.V. (NORTH HOLLAND), 
1 990, XP00804921 7 

2 The present application does not meet the criteria of Article 33(1 ) POT, because 
the subject-matter of claim 1 is not new in the sense of Article 33(2) PCT. 

2 1 The document D1 is regarded as being the closest prior art to the subject-matter 
of claim 1 , and discloses (the references in parentheses applying to this 
document): 

A dialog management system which supports a dialog between one or more 
applications and an application user (see col. 2, lin. 21-25). wherein each 
application provides its specific prompt application data (see col. 7, lin. 1 3-1 7, 30- 3» 
and fig 1 B ref. 1340), the output sounds being unique and distinctive for each application 
(see col. 6,' lin. 23-24 and col. 8. lin. 14-16) and being played back by the dialog 
manager to inform the user of the status of an application (see col. 1 1 . im. 4-i 4). 
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The same objection accordingly applies to its corresponding system claim 1 0 and 
computer program product claim 1 3. 

2 2 It is noted that the term "auditory icon" in claim 1 has been interpreted according 

to the description of the application on page 3. line 1 9-20. as "any type of sound used 
to describe a particular type of feedback from the application". Therefore, the prompt 
data referred to in document D1 falls within the scope of the term. 

3 Having regard to §2.2, in case that the term "auditory icon" were meant to 
exclusively refer to an artificial short sound chunk (earcon) or a pre-recorded 

sound chunk, thereby excluding a speech prompt as given in D1 (see. i.a.. fig. 7) the 
present application would not meet the criteria of Article 33(1 ) PCT, because the 
subject-matter of claim 1 would not involve an inventive step in the sense of Article 
33(3) PCT, the reasons being as follows: 

Document D1 discloses the use of a playback engine which can be called on 
playback by an application (see D1 . col. 1 4. lin. 5-1 9 and col. 1 6. lin 50-61 ) 
Furthermore, the disclosure of D1 does not limit the sound output of the system to 
speech but also suggests the use of other output sounds such as "earcons (^ee ^ m , 
col. 5, lin. 4-5). The skilled person would therefore be prompted to use earcons m 

the system described in document D1 . 

The use of earcons or auditory icons as audible feedback in dialog systems has 
been widely employed within the technical field, i.e. auditory Interfaces (see. as an 
example, document D2). The skilled person would therefore regard it as a normal 
design option to include this feature in the dialog management method descnbed in 
document D1 . thereby arriving at a method according to claim 1 . It is 
additionally noted, that document D2 also discloses the use of a distinctive set of 
earcons for a given application (see D2. pag. 216, last par. - pag. 217. par. 2). 

The same objection accordingly applies to its corresponding system claim 10 and 
computer program product claim 13. 

4 Dependent claims 2-5, 7-9, 1 1 and 1 2 do not cor)tain any features which, in 
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combination with the features of any claim to which they refer, nneet the 
requirements of the PCT in respect of novelty and/or inventive step. The additional 
features disclosed in said dependent claims are either disclosed in cited 
documents or either represent normal design choices extensively used in auditory 
interfaces. See documents D1 -D5 and the corresponding passages cited in the 
search report. 

5 The combination of the features of dependent claim 6 Is neither i^nown from, nor 
rendered obvious by, the available prior art. The reasons are as follows: 

In the method of document D1 , the unique and distinctive auditory icons for each 
application are given by a profile. In said method, the common dialog 
management system does not modify and/or choose the given set of auditory icons 
of an application in order to make them unique. The combination of features of claim 6 
is therefore new (Article 33(2) PCT). 

The problem to be solved is therefore regarded as how to avoid any confusion on 
the part of the user when two or more applications have similar or identical 
auditory icons in their repertory. 

There is no suggestion or hint in D1 that would prompt the skilled person to modify, 
the system of document D1 in order to perform a method as claimed in claim 6. In 
addition, although other prior art documents, such as document D2, also mention the 
importance of having distinctive sounds for each application (see D2. pag. 
last par - pag. 21 7, par. 2), the solution given by the application to the problem 
posed is not found in. nor suggested by, any of the available pnor art 
documents. The solution proposed is therefore regarded as involving an inventive step 

(Article 33(3) PCT). 
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□ Box No. til Non-establishment of oplnten with regard to novelty, inventive step and industnal apphcability 

Lack of unity of invention 

Reasoned statement under Rule 436fe.1 (a)(1) with regard to novelty, inventive step or industrial 
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Box No. I Basis of the opinion 



has been established on the basis of the International application in 



1 . With regard to the language, this opinion has been estaonshea o^ c 
the language in which it was filed, unless otherwise indicated under this item. 

n Thi.! ODinion has been established on the basis of a translation from the original language into the following 
Siguage wmSS is SXguage of a translation furnished for the purposes of .nternatK>nal search 
(under Rules 12.3 and 23.1(b)). 
9 With reaard to anv nucleotide anOtor amino acid sequence disclosed in the international application and 
TeSlSa^lo the d^^^ this opinion has been established on the basis of: 

a. type of material: 

□ a sequence listing 

□ table(s) related to the sequence listing 

b. format of material: 

□ In written format 

□ in computer readable form 

c. time of filing/furnishing: 

□ contained in the international application as filed. 

□ filed together with the international applicatton in computer readable form. 

□ furnished subsequently to this Authority for the purposes of search. 

3. □ in addmon, in the case that more than one v^^^^^^^^^^^ 

appropriate, were furnished. 

4. Additional comments; 
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Box No. V Reasoned statement under Bute 43t>fe.1 (a)(1) with regard tonovelty. Inventive step or 
industrial applicability; citations and explanations suppo rting such statement 

1. Statement 

Novelty (N) 

Inventive step (IS) 

Industrial applicability (lA) 



Yes: 


Claims 


6-8,11-12 


No: 


Claims 


1-5, 9-10, 13 


Yes: 


Claims 


6 


No: 


Claims 


1-5, 7-13 


Yes: 


Claims 


1-13 


No: 


Claims 
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Re Item V. 



Reference is made to the following documents: 

D1 • US-B1 -6 51 3 009 (COMERFORD ET AL) 28 January 2003 (2003-01 -28) 
D2- DATABASE INSPEC [Online] THE INSTITUTION OF ELECTRICAL 
ENGINEERS, STEVENAGE, GB; 15 December 1998 (1998-12-15), 
BREWSTER S: 'The design of sonically-enhanced widgets" XP002334092 

Database accession no. 61 66302 
D3: US 2003/098892 A1 (HIIPAKKA) 29 May 2003 (2003-05-29) 
D4- SAWHNEY N ET AL: "NOMADIC RADIO: SCALEABLE AND CONTEXUAL 
NOTIFICATION FOR WEARABLE AUDIO MESSAGING" CHI '99 
CONFERENCE PROCEEDINGS HUMAN FACTORS IN COMPUTING 
SYSTEMS PITTSBURGH. PA; NEW YORK. NY : ACM, US, 1 5 May 1 999 

sV^O May 1999 (1999-05-20) pages 96-103, XP000894208 ISBN: 

D5- GAVER AND SMITH: "Auditory icons in large-scale collaborative enviroriments" 
" HUMAN-COMPUTER INTERACTION - INTERACT 9° ^ DIAPER ET^^^^^^ 
(EDITORS) ELSEVIER SCIENCE PUBLISHERS B.V. (NORTH HOLLAND). 
1 990. XP00804921 7 

2 The present application does not meet the criteria of Article 33(1 ) PCT. because 
the subject-matter of claim 1 is not new in the sense of Article 33(2) PCX. 

2 1 The document D1 is regarded as being the closest prior art to the subject-matter 
of claim 1 . and discloses (the references in parentheses applying to this 
document): 

A dialog management system which supports a dialog between one or more 
applications and an application user (see col. 2, lin. 21-25). wherem each 
aoDlication provides its specific prompt application data (see col. 7, lin. 1 3-1 7, 30 3» 
aK 1 B ref 1 340). the output sounds being unique and distinctive for e"P^^--t'°" 
tsee col 6 lln. 23-24 and col. 8. .in. 14-16) and being played back by he dialog 
manager to inform the user of the status of an application (see col. 1 1 . l«n. 4-1 4). 
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The same objection accordingly applies to Its corresponding system claim 1 0 and 
computer program product claim 1 3. 

2 2 It is noted that the term "auditory icon" in claim 1 has been interpreted according 

to the description of the application on page 3. line 1 9-20. as "any type of sound used 
to describe a particular type of feedback from the application". Therefore, the prompt 
data referred to in document D1 falls within the scope of the term. 

3 Having regard to §2.2, in case that the tenn "auditory icon" were meant to 
exclusively refer to an artificial short sound chunk (earcon) or a pre-recorded 

sound chunk, thereby excluding a speech prompt as given in D1 (see, i.a.. fig. 7), tne 
present application would not meet the criteria of Article 33(1 ) PCT, because the 
subject-matter of claim 1 would not involve an inventive step in the sense of Article 
33(3) PCT. the reasons being as follows: 

Document D1 discloses the use of a playback engine which can be called on 
playback by an application (see D1 , col. 1 4, lin. 5-1 9 and col. 1 6, lin 50-61 ) 



=or;hrd=e o7d1 does not limit the sound output of the system to 
speech but also suggests the use of other output sounds such as earcons (^^^ J^^' 
col. 5, lin. 4-5). The skilled person would therefore be prompted to use earcons 



the system described in document D1 . 

The use of earcons or auditory icons as audible feedback in dialog systems has 
been widely employed within the technical field, i.e. auditory interfaces (s^e. as an 
example, document D2). The skilled person would therefore ^^^^^^^^f.^^^^ 
design option to include this feature in the dialog management method descnbed 
document D1 . thereby arriving at a method according to claim 1 . » 
additionally noted, that document D2 also discloses the use of a d.st.nchve set of 
earcons for a given application (see D2. pag. 216, last par. - pag. 217, par. 2). 

The same objection accordingly applies to its corresponding system claim 1 0 and 
computer program product claim 1 3. 



4 



Dependent claims 2-5. 7-9. 1 1 and 12 do not contain any features which, in 
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combination with the features of any claim to which they refer, meet the 
requirements of the PCT in respect of novelty and/or inventive step. The additional 
features disclosed in said dependent claims are either disclosed in cited 
documents or either represent normal design choices extensively used in auditory 
interfaces. See documents D1-D5 and the corresponding passages cited in the 
search report. 

5 The combination of the features of dependent claim 6 is neither known from, nor 
rendered obvious by, the available prior art. The reasons are as follows: 

In the method of document D1 . the unique and distinctive auditory icons for each 
application are given by a profile. In said method, the common dialog 
management system does not modify and/or choose the given set of auditory icons 
of an application in order to make them unique. The combination of features of claim 6 
is therefore new (Article 33(2) PCT). 

The problem to be solved is therefore regarded as how to avoid any confusion on 
the part of the user when two or more applications have similar or identical 
auditory icons in their repertory. 

There is no suggestion or hint in D1 that would prompt the skilled person to modify 
the system of document D1 in order to perform a method as claimed In claim 6. In 
addition, although other prior art documents, such as document D2. also mention the 
importance of having distinctive sounds for each application (see D2, pag. 21 6. 

last par. - pag. 217, par. 2), the solution given by the application to the problem 
posed is not found in, nor suggested by, any of the available prior art 
documents. The solution proposed is therefore regarded as involving an inventive step 

(Article 33(3) PCT). 
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Alternatively, the dialog management system might first request an application to 
supply only the relevant identifying information for each auditory icon in its set, such 
as a unique descriptive name or number, and any usage instructions associated with the 
5 different auditory icons. The dialog management system might then request each 

auditory icon only as the necessity arises, in order to reduce memory costs. The dialog 
management system might equally decide,^n fhej>asis of.the preceding, dialog flow 
which type of auditory icon it might require for a particular application in the near 
future, and it might request this auditory icon in advance from the application* 

For mappHcation that^does noravafihof-aisre-^^^ auditory icuns,the-dialog — 

management system can provide an appropriate set. To this end, the dialog management 
system might be able to determine the nature of the application and decide on a suitable 
set of auditory icons, or the user might choose to define the auditory icons himself. He 
might do this by locating a sound chunk in digital form, for example by downloading 
from the internet or extracting a suitable sound chunk from a soundtrack or song, or he 
might record a sound chunk using a recording apparatus and communicate the 
recording to the dialog management system. For example, he might record or obtain a 
recording of a Formula One racing car being driven at speed, transfer the recording to 
the dialog management system where it is stored in a local memory by the auditory icon 
management unit, and specify that this sound chunk be played whenever an application 
for providing sports news reports an update about a Formula One race. The user might 
also advantageously use the microphone of the dialog management system to record a 
suitable sound chunk. In a preferred embodiment of the invention, the dialog 
management system is equipped with a suitable interface for cormection to a portable 
memory such as a USB stick, memory card etc., or to any external network such as the 
internet, for the purpose of locating and downloading sound chunks for use as auditory 
icons. 
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In a particularly preferred embodiment of the invention, the dialog management system 
is able to provide an application with any auditory icons which it might require. For 
example, it might be that an apphcation only disposes of one or two auditory icons, for 
example to indicate the start of a process, or to indicate that an error has occurred, 
requiring the attention of the user. However, such a small selection might not be 
sufficient for an intuitive and easily understood dialog flow between the user and the 
application. In this case, the dialog management system might choose a set of smtable 
auditory icons from a selection available, and assign these to the application. 
Furthermore, it might be that two or more applications have similar or identical 
Wdit^ry^con-^in their repertoire. To avoid any confixston onnhe-part of theuser that- 
nught arise should both applications be simultaneously active, these auditory icons 
might be modified by the dialog management system in some way, or might be replaced 
by different, equally suitable auditory icons. For example, on loading a new apphcaUon. 
the dialog management system examines the auditory icons associated with the new 
appUcation. and compares them to the auditory icons already assigned to the other 
appUcations. If any of the new auditory icons is identical or very similar to any existmg 
auditory icon, ^e dialog management system preferably informs flie user, and suggests 
smtable alternatives if it has any available. If no suitable alternative auditory icons are 
available, the dialog m^agement system might prompt the user to enter smtable 



replacements. 



EKampl^ of audhor, icon, which an appUcatton might nse .o provide audible feedback 
„ «,e w a.. «.« auditory icons, to be played when a dialog flow between *e user 
and the application is activated or reactivated trotn stand-by. and end icons, to 

be played when the dialog flow between the user and the application is concluded, 
deadv^ed, or pU^d h> a st^td-by mode. Tbe s». anditory icon itsetf should reflect 
the nature of the application, while the end auditory icon nught sintply be the sounds of 
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the start icon, played in reverse order. An application might also use informative " 
auditory icons, whose sound contains some clue as to the nature of the application or 
the actual feedback type associated with this auditory icon. For example an appUcation 
for supplying weather forecast updates might play an auditoiy icon with weather- 
5 associated sounds such as wind for stormy weather, raindrops for rainy weather and 
birdsong for fair weather. Other examples of auditoiy icons might be those used to 
provide status or infomiation updates during the time tibiatanjqiphcafipnis For 
example, an application iiinning a personal digital assistant might have several auditory 
icons for supplying the user with different types of status feedback concerning 
10 appointments, incoming emails, due-dates for reports, etc. For example, the personal 
nligitalassistanrmight repeatedly renoand tbeuser of atrcqpcoming-^p^^^^ - 
appropriate audible icon, with the reminders becoming more and more peraistent as the 
appointment draws near. 



20 



15 In a preferred embodiment of the invention, the user might specify which audible icons 
of which applications he would like to hear during a dialog flow, by entering suitable 
information into a user profile. He might also specify the loudness of the auditory icons, 
and the number of times an auditory icon is to be played during the dialog flow. In 
addition, he can assign priorities to the various applications, so that feedback from an 
intercom takes priority over an application such as a personal digital assistant. In this 
way, the user ensures that he will always be informed of the higher-priority application 
in the event that higher- and lower-priority applications simultaneously report feedback 
in the dialog flow. The user profile can be considted regularly or after every 
modification by the auditory icon management unit to determine whether an auditory 
icon should be played back, the desired loudness, and the number of times this auditory 
icon can be played back during this dialog flow. 



25 



In a further preferred embodiment, the dialog management system can deduce user 
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10 



prefcrencrs by interpreting dial^fiSw. For exan^le, if an application has reported a 
reminder for an upcoming appointment by means of an appropriate auditory icon, and 
the user repUes "I know, I know", the dialog management system can interpret this to . 
mean that the user does not need reminding again, andmight suppress the auditory icon 
for this feedback the next time it is initiated by the application. This level of 
"intelligent" interpretation on the part of the dialog management system might also be 
specified by the user in the user profile. For a dialog management system used by more 
to one user, a number of user profiles can preferably be configured, so that each user 
has his own private user profile in which he can specify his own personal preferences. 

A dialog-mm^geWfit system accordingto the present inventioninighrperform-soine of 
Ihe processing steps described above by implementing software modules or a computer 
program product. Such a computer program product might be directly loadable into the 
memory of a programmable dialog management system. Some of the units or modules 
such as the core dialog engine, application interface unit and auditory icon management 
mnt can thereby be reahsed in the form of computer program modules. Smce any 
required software or algorithms might be encoded on a processor of a hardware device, 
an existing electronic device might easUy be adapted to benefit firom the features of the 
irxvention. Alternatively, the units or blocks for processing user input and the output 
prompts in the manner described can equally be realised using hardware modules. 

Other objects and features of the present invention will become apparent from the 
foUowing detailed descriptions considered in conjunction with the accompanymg 
drawing It is to be understood, however, that the drawing is designed solely for the 
25 purposes of iUustration and not as a definition of the limits of the mvention. for whrch 
reference should be noade to the appended claims. 

m sole figure, Fig.l. is a schematic block diagram of a dialog management system in 
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20 
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Not all applications will have a complete set of suitable auditory icons at its disposal. 
Some appUcations may not have any auditory icons at all. and some applications might 
even have identical auditory icons. To deal with such situations, the auditory icon 
5 management unit 1 1 can assign auditory icons to an application A. by choosing suitable 
ones from a collection of pre-defined auditory icons 13. For such an application, the 
user might prefer to have tiie auditory icon management unit 11 assign a particular 
sound recording to the application A. For example, the user might like to hear tiie 
sound of birdsong when the weatiier service A. reports, fair weatiier. If stormy weather 
10 is forecast, the user might like to hear the sound of tiiunder. The user can input tiies^ ^ 
-- - recordings as audio data in a suitable format via a user interface 15. and have tiie 

auditory icon management unit llassign them to tiie weatiu^r service apphcauon A.. 
Another way of supplying tiie auditory icon management unit 11 with such recordmgs 
is to download them from an external computer or a network 12 such as tiie internet, via 
15 a suitable interface 14, 

These different ways of obtaining auditory icon information allow tiie dialog 
management system 1 to collect all the information it requires in order to playback ^ 
relevant auditory icons as required in ttie dialog flow. 



20 
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Tie didog flow ia «us e«n>ple consim of conun^oaBoa t«wcen fl>» us». no. 
Aown ta to togrm. «.d to variom appUctions A,. A,. .... A. driven by to 
dWog maaagemeo. 1. The user iss«s spoken coan«»ds or requests ,0 to 

dialog managon^nt system 1 toough a nncrophone 5. spote. commands or 
^^ests are receded and digitised in an inpu. deiecdon arrangemo.. 4. whrch passes 
^ recorded speech input to a core dialog engine 8. This engine 8 comprises several 
blocks for performing to usual s«5.s involved in speech recognition - an audro 
interface block 20 perfonns some necessary digital signal processing on to mput 
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speech signal before forwarding it to an automatic speech recognTseTiiriMs extracts 
any recognisable speech components from the input audio signal and forwards these to 
a language understanding block 22. In the language understanding block 22, the spoken 
commands or requests of the user are analysed for relevance and passed on as 
5 appropriate to the dialog controller 23, which converts the user input into commands or 
requests that can be executed by the appropriate application Ai, A2, A3, ....A^. 

Should it be necessary to obtain some further information from the user, for example if 
the spoken commands can not be parsed or understood by the automatic speech 

10 recogniser 21 and language understanding 22 blocks, or if the spoken commands cannot 

be^appliedto anyiof the applications- Ai,-A2, A3, . . Aj-tharare-active, the dialog ■ ■ 

controller 23 generates appropriate requests and forwards these to a speech gen^ator 24 
where they are synthesized to speech. The audio interface block 20 performs the 
necessary digital signal processing on the output speech signal which is then converted 

15 in an sound output arrangement 6 such as a loudspeaker to give audible sound 7. 

In a typical example of a dialog flow controlled by the dialog management system of 
Fig, 1, the user might wish to enter an appointment into the diary of his personal digital 
assistant Ai. All he needs to do is to say "Enter appointment with tax advisor next 
20 Monday at 1 lam". The core dialog engine 8 converts the command into the appropriate 
form and submits it to the personal digital assistant application Ai, If the appointment 
can be entered without any problem into the p^sonal digital assistant Ai, the 
appropriate feedback is reported to the dialog management system 1, which chooses the 
appropriate confirmatory feedback - such as a spoken "OK" or "Roger" - to be output. 

25 

If an appointment is already scheduled for the same time on that day, the personal 
digital assistant Ai reports back to the dialog management system 1, where the 
application interface 10 and/or the dialog controller 23 interprets the application's 
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response, and ch o^s tfieliir-^priatc auStorirlcon - for exanq)^ the sound of claahing 
cymbals to indicate to the user that the new appointment clashes with an appointment 
already entered. Additionally, the dialog controller 23 triggers generation of a suitable 
prompt, eig. "You already have an appointment at 11am with Mr. So-and-so". 
OptionaUy. the user may deactivate the prompt output if detailed feedback is not 
desired by the user . 

In this example, the user has specified his preferences regarding the playback of 
auditory icons in a user profile, to customise or configure the extent to which he would 
hke to be informed about events occurring in the applications he uses, and which 
-appU^tiotts are to be^ccorded a higher priority in therdiabJracmr'n^ese-preferences- 
might endure until changed at some later time by the user, or they might be of a 
transitory nature. For example, dxe user might tell the dialog management system how 
to react within a certain period of time. For example, when the user says "Don't 
interrupt me for the next two hours unless it's really important", the dialog management 
system suppresses Hxe reporting of minor events occurring during the following two 
hours such as an automatic weather update, and postpones for two hours aU relatively 
unimportant events such as 24-hour reminders for upcoming scheduled appointinents 
"Dentist tomorrow afternoon at 3pm" . The user would only be interrupted by a 
relatively important event such as a scheduled appointinent during the specified time 
"Meeting with director in 15 minutes" or a telephone call from an cUent tagged m the 
telephone appUcation As as being important. The dialog management system decides 
^hat is important and what is relatively unimportant by examining the information 
Specified in the user profile 3. 

other preferences might specify the priority given to the applications if two or more 
applications indicate that auditory icons are to the played at ti.e same time. In this case 
the user has specified in the user profile 13 that the telephone A3 is to be assigned a 
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higher priority than the news and weather service A2. If the news and weather service 
Az is about to give its automatic news update, and an inconodng call arrives at the same 
time, the application interface 10 acknowledges that the telephone application A3 has 
the higher priority, and suppresses the auditory icon of the news and weather service 
5 A2, which may be postponed for output at a later point in time. 

Although the present invention has been disclosed in the JPormjof jgrcfiOT - 

embodiments and variations thereon, it will be understood that numerous additional 
modifications and variations could be made thereto without departing from the scope of 
10 the invention, for example the auditory icon management unit might be realised as part 

of'theT^re'*diaix)g"ei]gin^7^ be incorporated in another moTlule"STiclra[s~the"i3ialog 

controller. In one embodiment of the invention, the dialog system might be able to 
determine the quality of the current user's voice after processing a few utterances, or the 
user might make himself known to the system by entering an identification code which 
1 5 might then be used to access stored user profile information which in turn would be 

* 

used to generate appropriate control parameters for the audio interface. 

For the sake of clarity, throughout this application, it is to be understood that the use of 
"a" or "an" does not exclude a plurality, and "comprising" does not exclude other steps 
20 or elements. The use of "unit" or "module" does not lindt realisation to a single unit or 
module. 
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(XAIMS ■ ' 

1 . A method for driving multiple applications (Ai , A2, A3, ... , A„) by a common dialog 
management system (1) where a unique set of auditory icons (Si, S2, S3, , . Sn) is 
5 assigned to each application (Ai, A2, A3, . . An), and where the common dialog 

management system (1) informs a user 0 of the status of an application (Ai, A2, A3, . . . , 
^An) by playback, at^a specific pojnt in a dialog flow,,of a relevant auditoiy icon (Ii, I2, 
I3, . . . , In) selected from the unique set of auditory icons (Si, S2, S3, . , . , Sn) of the 
respective application (Ai, A2, A3, . . A„). 

10 

27A method according^ladrmlTWhere theauditors^^ I2, l3,~.::rIn)~*cff-aM 

application (Ai, A2, A3, ... , A„) are played back to indicate to the usar a change in 
operational status of an application (Ai, A2, A3, . . Aj^, 

15 3. A method according to claim 1 or claim 2, where an application (Ai, A2, A3, ... , An) 
submits a set of auditory icons (Si, S2, S3, • Sn) and associated instructions 
concerning the use thereof to the dialog management system (1). 

4. A method according to claim 3, where identifydng information for the individual 
- 20 auditory icons (Ii, l2, 13, . . . , In) of an application (Ai, A2, A3, ... , An) and associated 
instructions are obtained by the dialog management system (1), and the auditory icons 
(Ii, I2, 13, . . In) are retrieved by the dialog management system (1), from the 
application (Ai, A2, A3, . An) upon request. 

25 5. A method according to claim 3, where the complete set of auditory icons (Si, S2, S3, 
. . . , Sn) of an application (Ai, A2, A3, , . . , A„) is acquired by the dialog management 
system (1) at the outset of a dialog flow between the user and the application (Aj, A2, 
A3, ... , An) or upon activation or installation of the application (Ai , A2, A3, . . . , An). 
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eiTTS^od^^ding to any of the preTeding claims, where flie dialog numagement 

"" system (1) supplies an appUcation (Ai, A2, As, . ..,A^ with a unique set of auditory 

icons (Si, S2, S3 S„), by modifying non-unique auditory icons ai. fc. I3. «• » 

set of auditory icons (S,. S2. S3 Sn) of the appUcation (Ai, A2, A3, .... A.) and/or 

5 choosing unique auditory icons (Ii. I2. 13 U ^ application (Ai, A2. A3. . . A„) 

from a collection (13) of auditory icons. 

7. A method according to any of the preceding claims, where the set of auditory icons 
(Si. S2. S3. . ... Sn) for playback in a dialog flow between a user and an application (Ai. 
10 A2,A3,....A„) con^rises at least one unique start auditory icon, for playback at 

^commcircement of the dialog flow and/or-at-leastnsnrunique end auditory icDn,fbr 

playbadt at conclusion of a dialog flow. 
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8. A method according to any of the preceding claims, where the set of auditory icons 
(Si. S2, S3, . . S„) for playback in a dialog flow between a user and an appUcation (Ai. 

aJa3 A.0 comprises a number of unique mformatiYe auditory icons ai. I2. 13. 

!„)'. for playback at specific points during the dialog flow where each auditory icon (Ii, 
I2. I3. .... In) describes a particular type of feedback from the appUcation (Ai. A2. A3. 

• • •» An)* 

9. A method according to any of the preceding claims, where auditory icons (Ii, I2. h, 

I„) and/or playback characteristics of the auditory icons Oi. h, h, U are 
specified for a user in a user profile (3). 
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10. A dialog management systema') for driving a number of appUcations"(Ax, A2, A3, 
. An), comprising 

- an input detection arrangement (4) for detecting user input (5) to the system; 

- a sound output arrangement (6) for outputtiing audible prompt (7) ; 

- a core dialog engine (8) for coordinating a dialog flow by interpreting user 
input (5) and generating output prompts 0; 

- an application interface (10) for communication between ^edialgg 
management system (l^and the ^pUcations (Ai, A2, A3, . . . , A„); 

- a source of unique sets of auditory icons (Si, S2, S3, . . . , S„) assigned to the 
applications (Ai, A2, A3, . . Aa); 

- ^"and an-auditoTy-icon managem^nt-xuilrCll) f - 
icons (Ii, I2, 13, . . In) from the unique sets of auditory icons (Si, S2, S3, . .„ 
Sn) corresponding to the applications (Ai, A2, A3, . . A^) for playback at 
specific points in the dialog flow. 

15 

11. A dialog management system (1) according to claim 11, comprising a means (15) 
for allowing the user to input auditory icons (Ii, I2, 13, . • . , I„). 

12. A dialog management system (1) according to claim 11 or claim 12, comprising an 
20 interface (14) for obtaining sets of auditory icons (Si, S2, S3, . . ., S„) or individual 

auditory icons (Ii, I2, 13, . . . , In) from an external source (12) 

13. A computer program product directly loadable into the memory of a programmable 
dialog management system (1) comprising software code portions for performing the 

25 steps of a method according to claims 1 to 10 when said product is run on the dialog 
management system (1). 



